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(54) Method and apparatus for multi-resolution Image searching 



(57) A multiresolution method and apparatus for 
searching of a database of images where the search is 
performed on compressed images, without first decom- 
pressing them. The method searches the database of 
conrpressed images first at a low resolution to obtain 
the relative quality of a match between a search tem- 
plate and a candidate image. If the match is below a 
particular threshold, the search is terminated without 
committing any further computational resources to the 



search. Conversely, if the match is above a particular 
threshold, the method enhances the resolution of the 
candidate image and then performs another match. As 
long as the relative quality of the match is above the par- 
ticular threshold, the resolution of the carKiidate image 
is successively enhanced, until a match determination 
is made at a full resolution of the candidate image. 
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Description 



This invention relates to the field of image storage and retrieval and in particular to a method and apparatus for 
searching for a particular image contained within a database of images. 

Image databases are databases that contain digital data of images and are finding ever-increasing uses in busi- 
ness and entertainment. The widespread use of image databases, however, is intensif/ing the need to develop more 
effective ways of searching such databases. 

By way of background, a database is a collection of related data. Oftentimes, the data in a database are structurally 
organized as tables, fields and records. Generally, each record in the database possesses a set of attributes and a user 
may wish to conduct a search of the database based upon a value of one or more of th attributes. For example, in a 
database of football statistics, one may desire to search for all quarterbacks who completed 100 or more passes in a 
single season, etc. 

In conducting such a search, it is assumed that each record possesses several attributes and the user wants to 
search for records that possess certain values of certain attributes. The specification of which records are desired is 
called a query and is usually restricted to one of three types: a) A simple query which specifies a specific value for a 
specific attribute; e.g., THROWINGARM = LEFT; or THROWINGARM = RIGHT; b) a range which specifies a specific 
range of values for a specific attribute; e.g., WEIGHT < 220 or 180 < WEIGHT < 220; and c) a BOOLEAN such as 
(THROWINGARM = LEFT) AND ( HEIGHT > 6*) AND (COMPLETIONS > 99)). 

Unfortunately, such query-based methods do not solve the problem of searching an image database because 
image data is oftentimes not annotated with attribute descriptions. Consequently, and increasing interest and continuing 
need exists for developing search and retrieval methods which efficiently, quickly and accurately searches a database 
of images. 

Consequently, the prior art has has shown an increasing interest in searching image databases by image content. 
See. for example, M. Flickner et al.. "Query by Image and Video Content: The QBIC System", Computer, Vol. 28, No. 
9., pp. 23-32, September 1995. To perform such a content-based image search, one would typically select an image 
template and query the database to find images that "look like" the image template. An alternative form of this question 
is "where in a waveform B does a signal A occur?" 

In providing an answer to this latter question, the prior art has utilized correlation techniques from signal-processing 
to measure similarities of images in much the same way that they are used to measure the similarities of signals. Such 
correlation techniques require the computation of the circular correlation of an image x with a search pattern y where 
the circular congelation is defined to be tiie mathematical operation given by the formula: 



As used throughout the present application, input variables are denoted by lower case letters x and y where x is 
one of several possible images and y is a fixed pattern or subimage sought in images contained in an image database. 
Note that while images are two dimensional, all of the discussion herein is for one-dimensional row vectors x and y 
thereby simplifying the notation used. Those skilled in the art will readily appreciate that the extension to two dimen- 
sions is straightfonward. Additionally, and unless explicitiy stated otiienwise, the x and y vectors both have a length 
depicted as N. For search operations, if tiie sought pattern y is shorter than x, then, y is padded to length N by adding 
Os to its length. Rnally, x""" is used to denote the transpose of x, which changes the row A/ x 1 row-vector x into a 1 x A/ 
column vector. 

The fundamental operation for search operations is the circular correlation of x to y which is defined to be the math- 
ematical operation given by tiie formula: 





Typically, the circular correlation is used together with other functions such that a new function is produced whose 
peaks indicate positions within x that best match y. In operation, the circular con-elation produces a vector of length N 
from two vectors of length N. 
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As used herein, the notation {x • y)/|p denotes a subsampling of the correlation operation by taking components 
whose indices are equal to / modulo R, For example, if R = 4 and / = 1 , the subsampling operations extracts elements 
1. 5, 9, 13, ... from the circular correlation of x and y. Consequently, (x • y)iiFi is called subband / of {x • y). 

The invention of the present application advantageously uses wavelet transforms of images. A wavelet transform 

5 of an image x is for a wavelet transform H, where H is an A/ x A/ matrix, denoted by a A/-vector H x^. The wavelet trans- 
form is advantageous for image compression because it leads to transformed vectors with many components of small 
magnitude, which can be represented t>y a relatively small number of bits. Often these components are replaced by Os 
which are efficiently encoded in the wavelet transform. Those skilled in the art can readily appreciate that not only are 
the image representations reduced, but the time required to process the wavelet transforms is reduced as well because 

10 any zero components do not have to be processed during arithmetic operations. 

In the discussion that follows, it is assumed that the wavelet transform matrix H has a special structure. Specifically, 
it Is assumed that H is block diagonal with a block size of R. By definition, this means that H may be partitioned into 
individual blocks havirig a size Rx R, and that all of the blocks within H — except for the individual blocks that fall on 
the diagonal contain only Os. By way of example, the matrix Y below is a block diagonal matrix having a block size of 3. 

IS Its diagonal blocks are identical to each other, and the following discussion is limited to such t>lock diagonal matrices 
which have identical blocks down their diagonal. 
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In an article entitled "Orthonormal and Biorthonormal Filter Banks as Convolvers and Convolutional Coding Gain", 
which appeared in IEEE Trans. On Signal Processing, Vol. 41, No. 6., pp. 2110-2130, June 1993, P. Vaidyanathan 
proved a convolutional theorem for transformed vectors (hereinafter referred to as "Vaidyanathan's theorem"). Vakty- 
anathan's theorem states that given wavelet transforms of x and y. then some of the components of the circular convo- 
ys tution of X and y may be found without first transforming x and y from the wavelet domain back to the pixel domain. 
Graphically, the theorem may be depicted as in Figure 1 . 

According to this theorem and with reference to Figure 1 , when H is block diagonal having a block size R with iden- 
tical blocks along the diagonal. 



and where l/v is the identity matrix of size N, then subband 0 of the circular correlation of x and y is obtained from the 
wavelet transforms of x and y. by conputing the circular correlations of all subbands of x and y and adding these cor- 

45 relations together, component by component. 

Note that the computation does not require that the wavelet transforms be inverted. For example, if A/ = 32 and R 
= 4, each subband contains 8 components, and there are four such subbands. Vaidyanathan's theorem requires the for- 
mation of 4 subbands of x and y. the calculation of 4 circular correlations each of length 8, and then the addition of these 
together component by component to produce a single vector of length 8. This resulting single vector is exactly equal 

50 to subband 0 of the circular correlation of the full vectors x and y. 

Subband 0 of the circular correlation gives only a low-resolution version of the circular correlation. And while it may 
indicate that a match for a particular search may be present, there remains the possibility that no match exists. There- 
fore, an effective search method must be able to produce the remaining components of the circular correlation to 
resolve if a match is present. Conveniently. Vaidyanathan's theorem may be extended to the computation of other sub- 

55 bands of a circular correlation as indicated in Figure 2. 

With further reference to Rgure 2, to compute Subband y, the vector x is cyclically shifted to left by / positions, and 
then processed by the same mechanism that computes Subband 0. One ovenA^helming problem with this approach, 
however, is that it is excessively computationally expensive. For example, if it is assumed that the "cost" of computing 
the wavelet transform and the inverse wavelet transform are about equal, then the prior art metiiod depicted in Rgure 
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2 indicates that the cost of computing all of the subbands of the cyclic con'elation of x and y is the cost to compute R 
direct wavelet transforms for x and one for y, together with the cost of the cyclic correlations. 

However, the cyclic correlation of x and y may be computed by an alternative method, namely by tafdng inverse 
transforms of Hx^ and Hy"^, followed by cyclic correlations in the pixel domain. This alternative method incurs a cost 

5 equivalent to two wavelet transforms plus the cost of the cyclic correlations. Vaidyanathan's method requires R•^ more 
wavelet transforms. The net cost comparison depends on the relative cost of the cyclic correlations when done by Vai- 
dyanathan's method and when done in the pixel domain by inverting the transforms first. 

Clearly, the cost of the cyclic correlations depends on how they are computed. As indicated by Figure 3(a), the well- 
known convolution theorem provides an efficient way to compute these correlations. With reference to Figure 3(a), there 

10 it is shown a method for computing the circular correlation of x and y. A straightforward implementation of this conpu- 
tatlon requires multiplications A more efficient implementation for sufficiently large values of A/ is shown in Figure 
3(b]. As shown in Figure 3(b), to compute the circular correlation of x and y, one must first, compute their Fourier trans- 
forms; second, multiply the Fourier coefficients Xj and V/, point by point in the frequency domain; and third, take the 
inverse Fourier Transform of the point-by-point product. (Note that the notation F shown in Figure 3(b) denotes taking 

15 the complex conjugate of a Fourier Transform, and incurs a cost equal to that of taking the Fourier transform itself). 

As one skilled in the art can readily appreciate, the Convolution Theorem improves the efficiency of the calculation 
because each fonA/ard or inverse transform requires only about 5 A/ log A/ operations, and the point-by-point multiply 
requires only N. This is usually much less than the operations required to compute the circular convolution by more 
naive methods. To compare Vaidyanathan's method to the straightfonfvard one, the costs of each method are computed 

20 as follows: 

Straightforward Method: 

1) Invert Hx'''and Hyl (Cost: 2 wavelet transforms). 
25 2) Calculate Fourier Transforms of x and y (Cost: 2 A/ log A/ operations). 

3) Do the point-by-point multiplies. (Cost: N operations). 

4) Transform back to the pixel domain. (Cost: N log N operations). 

Total cost: 2 wavelet transforms plus 3 A/ log A/ + A/ operations. 

30 

Vaiydyanathan's method: 

1) For each subband, calculate the wavelet transform of x. (Cost: R wavelet transforms, or R-^ wavelet transforms 
if Subband 0 is available already). 
35 2) For each subband, calculate R cyclic correlations of length N/R. (Cost: per subband rt is A/ log N-N log R oper- 
ations; in total it is RN log N-RN log R). 

As can be readily seen, the total cost for Vaidyanathan's method is about R times as large as the straightfonvard 
method, which moves first to the pixel domain and then does fast correlation there. The stralghtfonArard method is not 
40 progressive. It requires a full calculation to obtai n any significant search result. And while Vaidyanathan's method is pro- 
gressive and can be discontinued before performing all of the operations, it is simply too computationally expensive to 
use in practice. 

Consequently, a continuing need exists in the art for methods and apparatus which conveniently, efficiently and 
inexpensively permit the searching of a large number of candidate images contained within an image database. 

45 The above problems are solved and an advance is made over the art according to the principles of the present 
invention whereby images are highly-compressed through the use of wavelet compression techniques, and Fourier cor- 
relation techniques are utilized to perform a high-speed search and retrieval of images contained in an image database. 

The method advantageously permits the searching of a database of images where the search is performed on the 
compressed images, without first decompressing them. Spedfically, the method of the present invention operates by 

50 searching the database of compressed images first at a low resolution to obtain the relative quality of a match between 
a search template and a candidate image. If the match is below a particular threshold, the search may be terminated 
without committing any further computational resources to the search. Conversely, rf the match is above a particular 
threshold, the method enhances the resolution of the candidate image and then performs another match. As long as 
the relative quality of the match is above the particular threshold, the resolution of the candidate image is successively 

55 enhanced, until a match determination is made at a full resolution of the candidate image. 

Viewed from another aspect, the present invention provides an apparatus for the efficient searching of images con- 
tained in an Image database. Further features and advantages of the present invention, as well as the structure and 
operation of various embodiments of the present invention are described in detail below with reference to the accom- 
panying drawings. 
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The teachings of the present invention can be readily understood by considering the following detailed description 
in conjurK:tion with the accompanying drawings, in which: 

Figure 1 is an illustration of a prior art method for generating subband 0 of a circular correlation; 

5 

Figure 2 is an illustration of a prior art method for generating other subbands of a circular correlation; 

Figure 3 is an illustration depicting a convolution method; 

10 Figure 4 is an Illustration of the first step of a multiresolution method in accordance with the present invention; 

Figure 5 is an illustration of the multiresolution method performed in a Fourier-wavelet domain in accordance with 
the present invention; 

15 Figure 6 is an illustration of a multiresolution method performed on right block-circulant matrices; and; 

Figure 7 is a flow diagram showing the steps performed for a multiresolution image search according to the present 
invention. 

20 A preferred embodiment of tiie invention will now be desaibed while referring to the figures, several of which may 
be simultaneously referred to during the course of the following description. 

The invention of the present application utilizes a multiresolution technique which overcomes the debilitating ineffi- 
ciency associated with the prior art. By way of additional background, in multiresolution wavelet decompositions there 
exist a sequence of matrices H-i , H2, etc. such that each successive matrix produces finer and finer wavelet transforms. 

25 In the following example, H2 is a coarse transform that is block diagonal with blocks of size F^, and operates on sub- 
bands, each of length N/f^. Hi is a fine transform matrix that is block diagonal with blocks of size N/R, and operates 
on R subbands, each of length N/R. There exists an update nnatrix U^2'^^^ refines H2 into by the equation: 

H, = UnH2. 



The matrix U12 is block diagonal with blocks of size R^. The blocks of U12 consist of R interlaced copies of the block 
matrix that is on the diagonal of . For example, let H2 be the coarse wavelet transform given by: 

35 



H, = 0.5- 
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The fine transform is given by the matrix Hi whose structure is given by: 
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H,=V2/2. 
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20 



The update matrix 11^2 's the matrix given by: 
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U„=V2/2 
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40 Note that the pattern of 1s and -1s in the one-step update matrix LI12 is the same as In the fine wavelet transform 
matrix except that the Is and -Is in U^g are interlaced every 2 apart and they lie within blocks of size 2 in Hi and within 
blocks of size 4 within U^g- 

With reference now to Figure 4, there it shows the structure of the computation when the convolution theorem is 
applied to Vaidyanathan's theorem for a wavelet transform that is block-diagonal with identical blocks of size R on 
45 the diagonal. 

Specifically, the R circular correlations are replaced by Fourier transforms F2 that operate on vectors of size N/R. 
The component-by-component multiplies are followed by inverse Fourier transforms to produce Subband 0 of the circu- 
lar correlation. Other subbands may be computed by applying this process recursively in a muhiresolution analysis. The 
process is efficient because the cost in computation is no greater than the cost of inverting the wavelet transforms first, 

so and following with the efficient implement of circular correlations in the pixel domain by means of Fourier domains in 
that domain and component-by-component multiplication. 

For a multiresolution analysis, the coefficients of Subband 0 mod are obtained as indicated in Figure 4. There 
are N/R^ such coefficients in each of R^ subbands. Subsequently, the relation represented by Figure. 5 is applied 
thereby obtaining the coefficients of Subband 0 mod R. There are N/R of these coefficients, or R times as many as In 

55 the coarse analysis. 

With further reference to Figure 5, there it shows two equivalent operations. In the upper part of Figure 5 it shows 
the SLfcsampling of the H transform Ibllowed by a coarse Fourier transform (F2), and then shows how to obtain the Fou- 
rier transforms for finer resolutions from the coarser ones. As shown In the Figure, the R^ vectors of length N/R^ are 
transformed by the matrices U12 • Each of these matrices is a square matrix of size N/R^ and is a block of the update 
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matrix U12 that refines into 

Figure 5 shows that the coarse transforrrts are upsampled. The upsampling interlaces together PF- vectors of length 
A//ff2 to create vectors of length N/R. (Interlacing the vectors (1,3,5,7), (2,4,6,8). (9,11,13,15). by (10,12,14,16) by 
upsampling by 2, produces the vectors (1.9,3,1 1 ,5,13.7.15) and (2.10.4,12,6.14,8,16.)) 
5 After the upsampling, and as shown in the Figure, the resulting vectors are transformed by the matrix T12. This 
matrix updates a fourier transform that operates on Interlaced vectors of length N/R^ to a fourier transform that operates 
on vectors of length N/R. That is, 1^2 satisfies the equation: 

F, = T„(l,xF,). 



The '"cross" operation In this equation indicates a matrix cross product, and in this case expresses the fact that F2 

f5 is a fourier transform that is repeated and interlaced with a period of length R to create a matrix of size N/R x N/R 
from a matrix F2 having size N/R'^ x N/R^. The number of operations required to perform T12 on the output of the inter- 
laced transforms F2 is proportional to N/R. Those skilled in the art will recognize that the computation at the top Is 
exactly equal to the computation at the bottom. That is, the effect of the fine transform followed by the fourier trans- 
form F^ may be computed by using the update matrices Ui2 ^d the fourier update matrix 1^2 on the fourier transforms 

20 of the coarse wavelet transforms. The amount of work is substantially less by the computation at the top because the 
Fourier update matrix requires only N/R operations instead of N/R log N/R operations. Moreover, it is not necessary to 
compute the full inverse fourier transform in Fig. 4 to obtain the fine subbands of the circular correlation. It is necessary 
only to conrpute the subbands that have not yet been computed, and this requires less work It requires one overall step 
with a number of operations proportional to N/R to do the global operations that affect all subbands, and then just the 

25 operations for the subbands that have not been computed. If R = 2, then half of the outputs are in Subband 0. which is 
already Known, and only half of the remaining computation of the inverse fourier transform has to be performed. 

Advantageously, the multiresolution method of the present invention is recursive and can be repeated on any out- 
puts shown in Figure 5 to create a fill resolution search. If the fill resolution search is carried out, the amount of compu- 
tation performed is precisely the same as if an inverse wavelet transform had been performed on the original image 

30 transforms, and then followed by a fourier transform from the pixel domain to the frequency domain, point-by-point mut- 
liplication in the frequency domain, and an inverse fourier transform back to the pixel domain. 

Figure 7 provides an overview of the steps necessary to perform a multiresolution search according to the present 
invention. Specifically, for a particular image a pattern template is transformed into a wavelet pattern at block 70. A can- 
didate image is then coarse correlated with the transformed pattern at block 71 and a determination is made at block 

35 72 whether the transformed pattern suitably matches the candidate image, if not, then another candidate image may 
be chosen or the search abandoned, 79. tf the match was suitable, then the candidate image is medium correlated 73 
and another similar match test is performed at block 74. The procedure proceeds similarly through blocks 75 and 77 
with fine correlated and fully correlated images respectively undergoing a suitable match check at blocks 77 and 78. If 
a suitable match is found for the fully correlated image at block 78, then the Image searched for has been found. 

40 In the discussion below, the following definitions are used: 

1 . The matrix l|sj is an identity matrix of size NxN. 

2. The notation A x B denotes the matrix cross product of matrices A and B, and is sometimes called the Kronecker 
product. 

45 3. The matrix F^ is a Fourier transform matrix that operates on vectors of length A/. 

4. The matrix F^ r is an interlaced Fourier transform matrix with the structure F^ x Ir, that is it has R interlaced 
copies of transforms of size M. 

5. The matrix T^ m,r is a Fourier update matrix that transforms F^.r into F^. That is. 

50 "C* — T* 17 

Those skilled in the art will recognize that Tnmr implemented by means of one stage of R-way butterfly 
operations. 

55 6. The matrix is an 8 x 8 discrete cosine transform (DCT) matrix that is used to create transforms of 8 x 8 subim- 
ages in a JPEG representation of an Image. 

7. The matrix H is an A/ x A/ matrix with the structure 1^ x Cg, where N = S M. The H matrix produces the JPEG 
transform of an image vector of length N. 

8. The matrix W is a 2 x 2 Haar transform matrix. It is given by: 
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W = 



1 1 
1 -1 



6. The matrix 



V2 = l, X W 



consists of 4 interlaced copies of W, and is of size 8x8. 
7. The nfiatrix V4 2 has the structure 



V4.2= I2 X (W XI2). 



Those skilled in the art will recognize that the matrix 



V4=l2 X(W X W) 



satisfies the equality 



V4=V4.2V2. 



8. The matrix Vs 4 satisfies the equality 



C8=VmV4,2 V2. 



Those skilled in the art can confirm that V3 4 satisfies the equation 

Va.4 = V(WXl4) 

where V is the matrix below: 
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V = 



1 

0 
0 
0 
0 
0 
0 
0 



0 

0.180 
0.375 
0 

0.0906 
0 
0 

-0.075 



0 
0 
0 
0 
0 

0.383 
0,924 
0 



0 

0.213 
0.768 
0 

-0.318 
0 
0 

-0.513 



0 
0 
0 
1 
0 
0 
0 
0 
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0.318 
-0,513 
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0.213 
0 
0 

0.768 



0 
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0 
0 
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0.924 
-0.383 
0 



0 

0.906 
-0.075 
0 

-0.180 
0 
0 

- 0.375 
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For a given tmage stored in JPEG format, a preferred multiresolution analysis that uses the invention is described 
» follows. 

1) To correlate an A/-vector image x stored as a JPEG transform Hx"*" with an instance of a pattern y, extend the 
pattern to the same length as x and compute its JPEG transform Hy"^. 

2) Coarse correlaton - Generate the Fourier transforms Fm,8Hx"^ and F M.sHy^- Multiply the transforms point-by- 
point and partition them into the appropriate number of sulibands of length M. Add these vectors, and take the 
inverse Fourier transform of the sum. For this example, every eighth point of the correlation is generated. 

3) Medium correlation - Multiply F^ eHx^ by 

(T2M>i,8 X L) (W X h)y^' 



30 and F M.eHy"^ by 

(tiMMs X I4) (W X I4)^^» 

35 thereby producing four interlaced Fourier transforms of size 2M. Multiply the resulting vectors point-by-point, and 
partition them into four subbands. Add the subbands, thereby creating a single vector of length 2M. Take the 
inverse Fourier transform of size 2/W, but after a first butterfly, operate only on elements that produce an odd com- 
ponent of the result. This yields a correlation at Indices that are multiples of 4 mod 8 of the full correlation. 

4) Rne correlation ■ Multiply the x and y transforms of the preceding step by (T4m,2M.4 x y V4 2 and (t 4m^m,4 x 
^ 12)^4 2, respectively. Each vector consists of two interlaced Fourier transforms of size AM. Multiply these transforms 

point-by-poim. partition into two subbands and add the subbands. Take the inverse Fourier transform of the result, 
and af ier the first butterfly stage, compute only the terms that contribute to the odd results. This produces the com- 
ponents of the conrelation whose indices are equal to 2 mod 8 and 6 mod 8. 

5) Full resolution - For the final step, multiply the x and y transforms from the last step by T8m,4m,2 ^2 f sm 4M 2 
45 V2 , respectively. Repeat the analysis noting that there is a single subband of length A/ = 8/W in'the transform vec- 
tors and in the transform of the correlation product. 

At this point, a number of advantages resulting from the multiresolution analysis of the present invention are appar- 
ent to those skilled in the art. Specifically, if the search is not going to succeed, and this is discovered early, the search 

50 can be terminated early in the multiresolution analysis, because match information is obtained early in the search. If the 
transforms to the image domain are done first rather than performing multiresolution analysis, then the work is commit- 
ted before any information is used, and the cost cannot be avoided later as search information is discovered. The wave- 
let representations tend to be sparse, that is, they contain many zeros, and this can reduce computational cost. The 
pixel domain representation is not sparse, because virtually all the pixels are nonzero. Consequently, it may be possible 

55 to exploit the sparsity in the wavelet domain and equivalent exploitation is not possible in the pixel domain. 

Those skilled in the art can appreciate that these results may be readily extended to more general matrices. Spe- 
cifically, the results extend to right bbck-circufant matrices. A right circulant matrix X is a square matrix in which each 
row is the same as the immediately preceding row, except that it is shifted cyclically to the right by 1 position. For exam- 
ple, the matrix X below is right circulant. 
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x= 



0 5 2 7' 

7 0 5 2 

2 7 0 5 

5 2 7 0 
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A right block-circulant matrix is a matrix composed of equal-sized submatrices (blocks), and each row of blocks is 
IS the same as previous row of blocks, except that it is shifted to the right by the size of 1 block. The matrix Y below is right- 
block circulant with a block size of 2. 
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35 The equality depicted in Figure 5 hoWs for block diagonal wavelet transform matrices whose diagonal blocks are 
equal, and they must satisfy the equation 

H = H = I. 

40 

Although these are common wavelet transforms, as, for example, the Haar wavelet, they do not represent the broadest 
class of wavelets in use. The wavelets of most interest have a transform equation that is right block-circulant, as, for 
example, the Debauchies wavelets. The modified form of Figure 5 for such wavelets is computationally just as simple, 
45 but it is slightly different and is given in Figure 6. 

The principle difference between the two figures lies in the update nnatrices u-12 and u . In Figure 5, ^ sub- 
block of the update matrix Uia, and can be obtained directly that matrix. Moreover, each instance of u^2 in Figure 5 uses 
the same matrix U12 for the computation. In Figure 6, the matrix u has to be calculated from Ui2. and the entries in 
the matrix u depend on the subband that it transforms. The matrices u can be computed by the formula: 

50 

u. = (F:XI,,)u,(f;'xi„,) 

55 where F2 is the Fourier transform in Figures. 5 and 6 that transforms vectors of length N/R^ and the matrix cross prod- 
uct operation interlaces fl^ copies of this matrix together across vectors of length AZ/ff^. The matrix 0 12 's block 
diagonal, and within its blocks along diagonal lines it contains Fourier transfornns of the rows of Ut2- For a search of one 
pattern over many images of the same size, the matrices U 12 can be computed once and stored reused when search- 
ing each image. 
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1 . A content-based image search method comprising the steps of: 

transforming a pattern-template such that the transformed pattern template may be correlated with a wavelet 
candidate image; 

coarse-correlating said candidate image in the Fourier domain; and 

comparing said coarse-correlated candidate image with said pattern-template to determine if their exists a suit- 
able match. 

2. The method according to claim 1 further comprising the step of: 

medium-correlating said coarse-correlated candidate image; and 

comparing said medium-correlated candidate image with said pattern-template to determine if their exists a 
suitable match. 

3. The method according to claim 1 or 2, further comprising the step of: 

fine-correlating said medium-correlated candidate image; and 

comparing said fine-correlated candidate image with said pattern-template to determine if their exists a suita- 
ble match. 

4. The method according to claim 1 , 2 or 3, further comprising the step of: 

fully-con-elating said fine-correlated candidate image; and 

comparing said fully-correlated candidate image with said pattern-template to determine if their exists a suita- 
ble match. 

5. An apparatus for performing a content-based image search comprising: 

means for transforming a pattern template into a transformed pattern template such that said transformed pat- 
tern template may be correlated with a wavelet candidate image; 
means for coarse-correlating said candidate image in a Fourier domain; and 

means for comparing said coarse-correlated candidate image with said transformed pattern-template to deter- 
mine if there exists a suitable match between the candidate image and the pattern template. 

6. An apparatus for performing a content-based image search according to claim 5 further comprising: 

means for medium-correlating said coarse-correlated candidate image; and 

means for comparing said medium-correlated candidate image with said transformed pattern-tenrplate to 
determine if there exists a suitable match between the candidate image and the pattern template. 

7. An apparatus according to claim 5 or 6, further comprising : 

means for fine-correlating said medlunrvcorrelated candidate image; and 

means for comparing said fine-con'elated candidate image with said transformed pattern-template to deter- 
mine if there exists a suitable match between the candidate image and the pattern template. 

8. An apparatus according to claim 5, 6 or 7, further comprising : 

means for fully-correlating said fine-correlated candidate image; and 

means for comparing said fully-correlated candidate image with said transformed pattern-template to deter- 
mine if there exists a suitable match between the candidate image and the pattern template. 
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